Phase separation of antiferromagnetic ground states in systems with imperfect nesting 
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We analyze the phase diagram for a system of weakly-coupled electrons having an electron- and a 
hole-band with imperfect nesting. Namely, both bands have spherical Fermi surfaces, but their radii 
are slightly different, with a mismatch proportional to the doping. Such a model is used to describe: 
the antiferromagnetism of chromium and its alloys, pnictides, AA-stacked graphene bilayers, as well 
as other systems. Here we show that the uniform ground state of this model is unstable with respect 
to electronic phase separation in a wide range of model parameters. Physically, this instability occurs 
due to the competition between commensurate and incommensurate antiferromagnetic states and 
could be of importance for other models with imperfect nesting. 
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I. INTRODUCTION 

Electron models having a band structure with imper- 
fect nesting are employed to analyze properties of sev- 
eral physical systems. For example, such models are 
used to describe: the antiferromagnetism (AFM) in Cr 
and its alloys^, superconducting iron pnictides and iron 
chalcogcnides 3 -"— , AA-stacked graphene bilayers 7 -, and 
other systems^. 

Postulating a spatially-homogeneous AFM ground 
state, a phase diagram for models with imperfect nest- 
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FIG. 1: (Color online) A typical phase diagram of a magnetic 
system with imperfect nesting in the (x, T)-plane, where x 
is the doping and T is the temperature. The solid (black) 
curve represents the Neel temperature Tn(x) separating the 
paramagnetic (PM) and the antiferromagnetic (AFM) states. 
The dashed (red) curve is the boundary Tq(x) between the 
commensurate (Q = 0) and incommensurate (Q 0) AFM 
states. This phase diagram is constructed for a finite density 
of states of non- magnetic electrons (n 7^ 0, see the text). 



ing can be constructed. A typical (a;, T) phase diagram 
is schematically shown in Fig. [1] This diagram is split 
into three areas. The first is the paramagnetic state at 
temperatures higher than the Neel temperature T^(x). 
If T < Tn(x) the system is in one of two magnetically- 
ordered states. The commensurate AFM state exists at 
relatively low doping (where the nesting is good) and 
higher temperatures, while the incommensurate AFM 
state appears at higher doping and lower temperatures 
(see Fig. [1]). Of course, in the commensurate phase the 
spatial variation of the order parameter is commensurate 
with the crystal lattice period. As for the incommen- 
surate AFM, its structure is characterized by the wave 
vector Q(x, T). This Q quantifies the smooth variation 
of the AFM order parameter in real space over distances 
much longer than the lattice spacing. Since Q is zero in 
the commensurate phase, the condition Q(ar, T) = de- 
fines the boundary temperature Tq(x) between the com- 
mensurate and incommensurate AFM. 

The phase diagram in Fig. [1] was obtained^ assuming 
that the ground state of the system is uniform. However, 
this assumption is not necessary valid: below we demon- 
strate that, depending on the doping and the tempera- 
ture, the homogeneous state may be unstable. To prove 
this we calculate the chemical potential T) for the 
model Hamiltonian of the itinerant AFM proposed by 
Ricei. We observe that dfi/dx is negative in a consider- 
able portion of the (a;, T)-plane. The homogeneous state 
compressibility, therefore, is negative, and such state is 
unstable with respect to electronic phase separation. 

It is not difficult to check a particular model for the 
phase separation instability: an interval of dopings where 
grand potential Q is a concave function is the signature 
of phase separation. Yet, the phenomenon is sometimes 
overlooked due to the fact that other important proper- 
ties of a homogeneous state bear little or no signature 
of the underlying instability. For example, the single- 
particle gap of a homogeneous state may be a smooth 
decreasing function of doping 7 -, and rises no suspicion 
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that, in fact, the state is unstable. Thus, a separate as- 
sessment of the thermodynamic stability is required. 

In this study we will restrict ourselves to the Rice 
model. However, the discussed mechanism for the phase 
separation could be of importance to other systems with 
imperfect nesting. For example, there are experimental 
indications that pnictidcs and chalcogenides may experi- 
ence such a phenomenon in some regions of doping and 
temperature^. 

This paper is organized as follows. In Sec. |TT] we in- 
troduce the model Hamiltonian and derive the equations 
describing the homogeneous states of the model. The 
instability of the homogeneous states are presented in 
Sec. IIII1 The discussion and conclusions can be found in 
Sec. El 

II. MAIN EQUATIONS OF THE MODEL 

We study the model proposed by Ricei to describe the 
incommensurate antiferromagnetism in chromium (see 
also the review in Ref. 0). We mostly adhere to the 
notation of Ref. [l|. However, to comply with modern 
conventions, some changes will be introduced. We also 
correct some misprints present in the latter reference. 

The model band structure has one spherical electron 
pocket and one spherical hole pocket with different radii 
(imperfect nesting), as well as other band or bands, which 
do not participate in the magnetic ordering. All interac- 
tions are ignored except the repulsion between the elec- 
trons in the ordering pockets. 

The system we study is three-dimensional. Its Hamil- 
tonian has the form 

H=J2 ^(kK. + ^E a k +q A^- q ^W, (i) 

k.CT kk'q 

where a is equal to either a (electron pocket), b (hole 
pocket), or c (non-magnetic bands). Also, (6^) are cre- 
ation operators for the electron in the a (b) pocket, n a 
is the number operator, V is the Coulomb interaction, 
and V is the volume. The non-magnetic non-interacting 
c band has finite density of states N r at the Fermi en- 
ergy. The energy spectra for the electron and hole pock- 
ets measured relative to the Fermi energy are taken as 
(h=l) 

e a (k) = v F (k-k Fa ) =v P (k-k P )-n, (2) 
e b (k+Q ) = —Vf (k-k Fb ) = -v F (k-k F )-^i, (3) 

where k F = (k Fa + k F b)/2, [i = v F (k Fa — k F b)/2 is 
the chemical potential, and the wave vector Qo connects 
the centers of the electron and hole pockets in reciprocal 
space. We confine ourselves to the weak-coupling regime: 
VN m < 1, where N m = k F /2-n: 2 v F . 

We treat Hamiltonian ([1]) with a mean-field approach. 
This is admissible since mean-field approximations give 
accurate results for weakly-interacting electrons. The 



starting point of our derivation is the case of perfect nest- 
ing, which corresponds to /i = 0. Under this condition, 
the radii of the electron and hole pockets are identical. 
If we translate the electron pocket by the vector Qo, its 
Fermi sphere coincides perfectly with the Fermi sphere 
of the hole pocket. 

Mathematically, the Hamiltonian Eq. ([1]) is equivalent 
to the BCS Hamiltonian. Indeed, if we perform the fol- 
lowing transformations 

h -> b{, b{ -> b k , (4) 

the interaction constant V and the hole pocket dispersion 
Eq. © change sign. The Hamiltonian for a and b bands 
becomes identical to two copies of the BCS Hamiltonian. 
This mapping is very useful since it allows to use the 
familiar BCS mean-field approach to study the Hamilto- 
nian ([T]). 

Performing standard BCS-like calculations, it is easy 
to show that for fi = the system is unstable to 
the ordering with the AFM order parameter Ao = 
V £k( a k, A+Qo.-a)- In thc weak-coupling limit 

A = e F cxp(-l/N m V) <C e F , (5) 

where e F — v F k F is the Fermi energy. 

The order parameter Ao couples electrons with un- 
equal momentum. Consequently, in real space the order 
parameter Ao corresponds to the rotation of the magne- 
tization axis with wave vector Q . Since usually the a 
and b pockets are located in the high-symmetry points 
of the Brillouin zone, the vector Qo is related to the un- 
derlying lattice structure. Thus, this order may be called 
commensurate . 

Now consider the case of non-zero \x. In such a situ- 
ation the electron and the hole Fermi spheres have dif- 
ferent radii, and do not coincide upon translation. How- 
ever, the distance between the translated spheres remains 
small if n is small. 

It is likely that Ao remains metastable for small non- 
zero fi. Yet, one may try to optimize the energy further 
by treating the translation vector Qi = Qo + Q as a 
variation parameter. The new order parameter has the 
form: 

A = ^E(4.A +Ql ,-.)- (6) 

k 

Unlike Qo, whose magnitude is of the order of the magni- 
tude of the primitive reciprocal lattice vectors, the vector 
Q is small: 

|Q| ~ \&\/v F < |Qo|- (7) 

Thus, the order parameter A describes order with a 
slowly-rotating AFM magnetization axis. The real-space 
wavelength of the axis rotation is equal to 27r/|Q|. This 
value is unrelated to the underlying lattice. Therefore, it 
is natural to call such order incommensurate. 
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If the transformation Eq. ((4]) is performed on a system 
with non-zero [i, the Hamiltonian of our magnetic system 
becomes the Fulde-Ferrel-Larkin-Ovchinnikov (FFLO) 
Hamiltonia n 10 ' 11 of a superconductor in the finite Zee- 
man field ijl bH = —fx. Moreover, the magnetic order pa- 
rameter ([6|) becomes a superconducting order parameter. 
Superconducting order of this type was first studied by 
Fulde and FerreUS, while Larkin and Ovchinnikov-ii con- 
sidered the order parameter (Ae zCJir + A*e _zQir ). The 
latter order parameter periodically passes through zero 
in real space. Below we will follow Ricei, and use the 
Fulde-Ferrel-type order parameter Eq. (J5|). The Larkin 
and Ovchinnikov version, recently applied by Gor'kov 
and Teitel'baum^ to study the coexistence of the AFM 
and superconductivity in pnictides, will be discussed in 
Sec. El 



Equilibrium parameters of the system can be derived 
by minimization of the thermodynamic potential 
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where N is the operator of the total particle number, and 
ks = 1. To evaluate £1 in the mean field approximation, 
we need the eigenenergies of the mean-field Hamiltonian. 
These are 



(A = 0) 

5Q = Q(A,Q,n,T) -ft(0,Q,/i,T) 
ir 2 e F ) A„ 2 



(14) 



7T 2 T 2 



OO 1 1 

tJ^J d V ln[f(Qr 1 - f i-e)f(fi-Qr 1 -e)] I , 



where e = \/A 2 +£ 2 , and /(e) = 1/[1 + cxp(e/T)] is the 
Fermi function. 

The equilibrium values of the gap A and the magni- 
tude of the structural vector Q are determined by min- 
imizing 50,. Thus, they are solutions of the equations 
d(50)/dA = and d(50)/dQ = 0. Differentiating 
Eq. (fT4"]) we derive straightforwardly 
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Then the grand potential O = 0(A, Q, fi, T) equals to 
2A 2 ^ f d 3 k 
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(10) 



Here the first and the second terms are the contributions 
of the ordering bands, while the third term corresponds 
to the reservoir bands. To carry out the integration over 
k, we expand the band energies in powers of |Q| and 
5k = Ikl - k F : 



e b (k + Qx) + e Q (k) w 2^ + 2Q77, 
e b (k + Qi) - e a (k) » 2v F 5k + 2Qrj, 
„ vf\Q\ 



(11) 
(12) 

(13) 



where 77 is the cosine of the angle between k and Q. 

Performing the integration, one finds the following 
expression for the difference of the grand potentials in 
the AFM state (A / 0) and in the paramagnetic state 



where Ao is given by Eq. For fixed values of T and 
fi, this system must be solved for A and Q. 

Once A and Q are found, the total number of elec- 
trons per unit volume n(fi) can be calculated. The latter 
quality is the sum of the numbers of magnetic n m (fj,) and 
non-magnetic electrons n r {[i). The doping x is defined 
as the difference 

x = n{n) - n(0) = n m {n) + n r (p) - n m (0) - n r (0).(17) 

Since fi, T <C e F , we have for the non-magnetic part 

nrOO = n M (°) + N rP- (18) 

The number of electrons in the magnetic bands is given 
by 

n m (fi) = [/(Si(k) + f(E 2 (k) - (j,)] . (19) 

Thus, the doping is equal to 

00 1 
x njj, f d£ 

x~o ~ ~Aq + J 2A~ , 
-1 



where xq = 4AoN m and 



dq [f(e-fi + Qri)-f(e + fi-Qri)}, 

(20) 



N r 
2K 



(21) 



Note that the integrals in Eqs. ([IS]). ([IS]), and fl20Jl can be 
evaluated exactly at T = 0. Thus, at zero temperature 
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the integrals are replaced by transcendental functions. 
The corresponding equations were derived in^^ using 
somewhat different notation. Notice, however, that zero- 
temperature expressions of Ref. [l] contain several mis- 
prints. For example, Eq. (6) of Ref. [l| has an incorrect 
minus sign for function G [cf. Eq. (8) of Ref. [13 shows 
the correct plus sign]. Further, in the definition of r± 
a factor of (1/2) must be placed in front of Q, see our 

Eq. ra. 



INSTABILITY OF THE UNIFORM 
GROUND STATE 



III. 



Now we are ready to construct the phase diagram of 
our model as a function of temperature and doping. The 
three coupled Eqs. (fT5j) . p^|) . and (|2"0)) are solved numer- 
ically. These determine A(x,T), Q(x,T), and //(x,T). 
Using these results we can calculate the Ncel tempera- 
ture T N (x), for different values of n, as the lowest T where 
A = 0. The transition temperature Tq between the com- 
mensurate and incommensurate AFM corresponds to the 
highest doping at which Q = 0. As a result, we obtain 
the phase diagram of the type shown in Fig. [T] 

However, constructing Fig.[T]wc assumed a priori that 
the ground state of the model is uniform. To check this 
assumption we plot the dependence of the chemical po- 
tential on the doping, for different temperatures. For 
different values of n the results are shown in Figs. 2(a, b, 
c). Curves fJ.(x) demonstrate three important features at 
temperatures lower than T* w 0.317Ao, for any n. First, 
the derivative dpt/dx is discontinuous at the transitions 
from commensurate to incommensurate AFMi, and from 
incommensurate AFM to the paramagnetic phase. The 
second major feature is that fx(x) has three different val- 
ues for a range of doping x at low T if n > 1, which 
means that we have to choose the lowest energy solution 1 . 
Thirdly, the derivative d/i/dx is negative at a finite range 
of doping. 

This last peculiarity of dfi/dx eluded the attention 
of previous studies; yet, it has very important ramifi- 
cations. Negative values of the derivative d[ijdx mean 
that the compressibility, k oc dx/dfi, is negative. This 
negative compressibility indicates that the homogeneous 
state is unstable towards phase separation. In the phase- 
separated state the system segregates into two phases 
with different doping values. Let us denote these val- 
ues as x\ and X2, and the volume fractions of the cor- 
responding phases as p\ and P2, such that pi + P2 = 1- 
Then, the doping satisfies x = p\X\ + (1 — pi)x2, and 
Pi = {X2 - x)/(x2 - Xi). 

The values x\ and X2 can be found using the Maxwell 
construction (e.g., Ref. [i~2l) . Figure 3 illustrates the latter 
concept: the horizontal dashed line is drawn such that 
the areas of the shaded regions, S\ and S2, are equal: 

Si = S2- 

Using the Maxwell construction, the boundary Tpg(x) 
between the homogeneous and phase-separated states is 
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FIG. 2: (Color online) Chemical potential \x versus doping 
x for different values of n [see Eq. (|21[) ]: n — (a), n = 1 
(b), and n = 3 (c). The different temperatures considered 
include: T = with solid (black) curves 1, T/Ao = 0.1 with 
solid (red) curve 2, T/Ao = 0.2 with solid (blue) curve 3, and 
T/Ao = 0.35 with solid (green) curve 4. Dashed (orange) 
lines correspond to n(x) in the paramagnetic phase. 



calculated. This boundary is shown by the dashed (red) 
curves in the (x, T) phase diagrams drawn in Fig. 4, for 
different values of n. 

The phase with lower doping, x\, is the commensu- 
rate AFM (Q = 0) while the phase with higher doping, 
x 2 , is the incommensurate AFM (Q 7^ 0), as it can be 
readily seen from Figs. 2, 3. Thus, here the phase sepa- 
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0.4 0.: 

Doping X/X {n+i) 

FIG. 3: (Color online) Chemical potential fj, versus doping x 
for the homogeneous phase, T/Ao = 0.1 and n = [solid (red) 
line]. The horizontal dashed (black) line shows the Maxwell 
construction, with shaded areas Si = S2. 



ration occurs due to the competition between two AFM 
states with different structures. So, it is natural that the 
boundary temperature Tq lies between two lines Tps sep- 
arating the homogeneous and inhomogeneous states (see 
Fig. 4). The phase separation is absent for higher tem- 
peratures T > T* « 0.317A . This phase separation dis- 
appears simultaneously with the incommensurate AFM 
phase. The area of the incommensurate AFM phase in 
Fig. 4 decreases, when n (which is proportional to the 
density of states in the non-magnetic band) increases. 
However, one must remember that in Figs. 2-4 the hori- 
zontal scale changes when n changes. 



IV. DISCUSSION 

In the previous section we demonstrated that the in- 
commensurate AFM state of the Rice modeli is unstable 
toward phase separation. This feature is likely to have 
important consequences for the diverse set of materials 
where the nesting degradation may be responsible for 
the destruction of the magnetic phase: chromium and its 
alloys^, pnictides and chalcogenidea^, doped AA-stacked 
graphene bilayer— , and others. Here we would like to dis- 
cuss the obtained results and compare these with other 
published works. 

Above we used the mapping between the Rice model 
and the FFLO superconductor. However, usually, the 
phase separation is absent from the phase diagram of the 
FFLO superconductor. This has a very simple explana- 
tion: these diagrams arc plotted as a function of the tem- 
perature and the Zceman field (which is an analog of the 
chemical potential /j, in the Rice's model). The field, be- 
ing an intensive thermodynamic quantity, does not allow 
for phase separation. Instead, the system experiences a 
first-order transition as a function of the Zceman field 10 . 
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FIG. 4: (Color online) Phase diagram of the Rice model^ for 
n = (a), n = 1 (b), and n = 3 (c). The solid (black) curves 
represent the Neel temperature Tn(:e), which separates the 
paramagnetic and AFM phases. The dotted (blue) curves 
are Tq(x), the boundary between the commensurate (Q — 
0) and incommensurate (Q 7^ 0) homogeneous AFM phases. 
The dashed (red) curve, Tps{x), is the boundary between the 
uniform and phase-separated (shaded areas) phases. 



However, for cold atoms in an optical trap it may be pos- 
sible to control not the field, but the polarization, which 
is an extensive quantity. In this case, phase separation 
occurs^. 

As we mentioned above, besides Eq. ([B]), it is possi- 
ble to consider other types of spatially-inhomogcncous 
order parameters. A particularly interesting possibility 



6 



was discussed in Ref. [H, where the known numerical re- 
sults for the two-dimensional FFLO superconductor— 
with an order parameter of the Larkin-Ovchinnikov's 
type was applied to study the Rice model. It was 
proposed^ that, upon small doping, the order parame- 
ter in real space forms domain walls. At a domain wall 
the gap vanishes locally, which makes these walls a pre- 
ferred place for the accumulation of the doped charge. It 
was demonstrated^^ that the formation of these domain 
walls becomes energetically favorable for 

H > now ~ 0.655A . (22) 

The value of (Idw is somewhat smaller than 

l#> s « 0.7A , (23) 

which is the value of the chemical potential correspond- 
ing to the phase separation in the two-dimensional Rice 
model at T = 0. Since at low doping the energy can be 
approximated by 

E = E a + f (i(x')dx' ^E + fj,{0)x, (24) 
Jo 

where Eq is the energy of the undoped state, we must 
conclude that at low doping the phase-separated state is 
less favorable than the phase with domain walls. How- 
ever, the difference 

tf?s ~ Hdw « 0.05A (25) 

is small, and in real systems the balance may be shifted 
by the factors unaccounted by the present model (e.g., 
anisotropy, Coulomb interaction, disorder, etc.). Thus, 
the possibility of phase separation driven by the mecha- 
nism proposed in this paper should be kept in mind when 
experimental data are analyzed. 

The experimental observation of phase separation in 
superconducting pnictides and chalcogenides, which may 
be approximately described by the Rice model^, was re- 
ported in several papers^. For example, Park and co- 
authors^ found the coexistence of magnetic and non- 
magnetic domains with a typical size ~ 65 nm. This 
observation is in general agreement with our proposed 
mechanism. While our model predicts the separation 
into two magnetic phases, the AFM order in the incom- 
mensurate phase is weak, and the energy is close to the 
energy of the paramagnetic phase. Thus, either the AFM 
order parameter in the incommensurate phase is below 
experimental sensitivity, or, being affected by factors out- 
side of our simple treatment, the weak phase itself is re- 
placed by the paramagnetic state. The latter scenario 
is quite likely, given the small energy difference between 
the paramagnetic and incommensurate AFM states. If 
the incommensurate AFM is destroyed, phase separation 
occurs between the undoped commensurate AFM and 
the paramagnetic states. Such type of phase separation 
was discussed for AA-stacked graphene bilayers^, whose 
band structure corresponds to the two-dimensional Rice 
model. 



Let us briefly mention several complications not con- 
sidered here, which, nonetheless, may be present in ex- 
perimental systems, and influence the resulting phase di- 
agram. In experiments, the electron and hole pockets 
may have non-identical non-spherical shapes and differ- 
ent Fermi velocities. How these factors affect the phase 
separation is a subject of further study. In the weak- 
coupling regime, Eq. ([5]), it is likely that sufficiently small 
deviations from the idealized model will not affect qual- 
itatively the outcome of the calculations, provided that 
V is not too weak. 

Our calculations were performed in the weak-coupling 
limit. Would the phase separation survive outside of this 
regime? Note that in order to discuss the intermediate 
or strong-coupling regime, the Rice model is not a good 
starting point. Rather, a multi-orbital lattice Hamilto- 
nian is a better approach. For such models the phase 
separation is a common phenomenon! 16 ' Further, re- 
cent numerical studies of the Hubbard model at interme- 
diate and strong coupling^ reported phase separation at 
finite doping. Thus, it is likely that even for strong and 
intermediate interaction strengths it is possible to find a 
region of the model's parameter space where phase sepa- 
ration occurs. Although, in such regimes the mechanism 
of phase separation cannot be described in terms of Fermi 
surface nesting. 

To apply the theoretical results to experiments it is 
important to consider the effects of disorder. We know 
that the FFLO state is very fragile with respect to im- 
purity scattering^. Thus, our incommensurate AFM, 
which is the mathematical analog of the FFLO phase, is 
expected to be susceptible to microscopic imperfections. 
Therefore, we conclude that the disorder-induced modi- 
fications to the phase diagram is an open question which 
requires special attention. 

The study of characteristic scales and geometry of the 
phase separated state is beyond the scope of this study 
since it requires additional information on the proper- 
ties of the system, which are disregarded by the Rice 
model. For example, even in the simplest approach to 
this problem, the structure of the inhomogeneous state 
is governed by the interplay between long-range Coulomb 
interaction and the energy of the boundary between dif- 
ferent phases^ Thus, it is reasonable to study the details 
of the phase-separated state only if the particular physi- 
cal system is specified in detail. 

In conclusion, we have demonstrated that the uniform 
ground state of the Rice model for an itinerant AFM 
with imperfect nesting is unstable with respect to elec- 
tronic phase separation in a significant range of dopings 
and temperatures. In this range, the uniform system seg- 
regates into two AFM phases, one of which is the com- 
mensurate AFM, while the second is the incommensu- 
rate AFM. It is argued that such instability can occur in 
other models with imperfect nesting because this effect is 
driven by the competition between phases with different 
doping and different magnetic structures. 
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